(19) 



J 



EuropSisches Patentamt 
European Patent Office 
Office europden des brevets 



(12) 



(43) Date of publication; 

ia03.1999 Bulletin 1999/10 

(21) Application number: 98116571.5 

(22) Date of filing: 02.09.1998 



(11) EP0 901 102 A2 

EUROPEAN PATENT APPLICATION 

(51) Intel.®: G06T 1/00 



(84) 


Designated Contracting States: 


* Yoshlura, Hiroshi 




AT BE CH CY DE DK ES R FR GB GR IE IT LI LU 


Bunkyo-ku, Tokyo (JP) 




MC NL PT SE 


• Nakamura, Masafumi 




Designated Extension States: 


Tsurumi-ku, Yokohama-shi (JP) 




AL LT LV MK RO SI 


* Aral, Takao 






Midori-ku, Yokohanna-shi (JP) 


(30) 


Priority: 03.09.1997 J P 238030/97 


• Takeuchi, ToshifumI 




16.04.1998 JP 106037/98 


Ota-ku, Tokyo (JP) 


(71) 


Applicant: Hitachi, Ltd. 


(74) Representative: 




Chlyoda-ku, Tokyo 101-8010 (JP) 


Beetz & Partner 


(72) 




PatentanwaKe 


Inventors: 


Steinsdorfstrasse 10 




Ectiizen, Isao 


80538 Munchen (DE) 




Kohoku-ku, Yokohama-shl (JP) 



(54) Watermark embedding method and system 

(57) A data embedding method and apparatus and 
a data reproducing method and apparatus are provided 
which can apply a digital watermark to various conterrts. 
Instead of embedding watermarking information in 
respective pixels or by using a relation between pixels, 
the watermarking information is embedded as a posi- 
tion pattern (4) of changed pixels (3) in the contents. 
Reliability comparable with conventional techniques can 
be obtained irrespective of a change in a smaller 
number of pixels for the contents. 
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Description 



SUMMARY OF THE IfWENTION 



BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to a method and 
system for embedding information such as a copyright 
notice in data, and nrtore particularly to a digital water- 
mark eml^edded in an image. 

Description of the Related Art 

[0002] Digital watermarking is applied to various con- 
tents. A watermark embedded in an image will be 
described by way of example. Information of a digital 
watemnark is embedded in an image by modifying pixel 
values such as luminance components, and frequency 
components so that a set of images represents particu- 
lar inforrrotion of "0" or T. In conventional techniques, 
for example, in "Still Image Data Hiding in Pixel Blocks", 
Shimizu et al., Proc. of IPSJ 53rd Annual Conference. 
1996. the values of two pixels are changed minutely to 
represent "0". or "r based upon a difference of values 
between two pixels. However, the following two condi- 
tions are required to be satisfied, when a digital water- 
mark is to be embedded. 

1) It is necessary that an image embedded with 
watermark information hardly changes from an 
original image (that the watermark is invisible). 

2) It is necessary that embedded infomriation is 
hard to be erased during an image conversion proc- 
ess such as JPEG compression ("Digital Conrpres- 
sion and Coding of Continuous-Tone Still Images", 
iSO/IEC/0918-1). 

[0003] An enror rate of each bit subjected to JPEG 
compression Is 0.1 to 0.2. In order to lower the bit error 
rate of JPEG compression to a -8 power of 10, it is nec- 
essary to provide each bit of an embedded watermark 
with a redundancy of ten times or higher, so that the val- 
ues of a number of pixels are necessary to be changed. 
Since the values of a number of pixels and frequencies 
are required to be changed in order to lower the bit error 
rate, there is a tradeoff between a reliability of water- 
mark data detection and a quality of contents. 
[0004] An image conpression process such as MPEG 
is necessary for an in^ge having a large amount of data 
such as a moving image. In such a case, it is essential 
to delect watermark data under the condition of MPEG 
compression, i.e., under the condition of MPEG 
streams. It is also necessary to prepare a fundamental 
function of detecting a watermark under the image con- 
dition. In this case, a detector system is required to have 
a MPEG decoder, increasing its cost and process time. 



[0005] It is an object of the present invention to pro- 
vide digital watermark embedding/detecting techniques 
5 capable of minimizing the number of pixels to be 
changed in order to embed a digital watermark, while a 
reliability of detecting embedded data is maintained 
high. 

[0006] It is another object of the invention to provide a 
10 digital watermark embedding method and system capa- 
ble of suppressing as much as p)ossible the quality of 
contents from being degraded upon nrKXlrfication of pix- 
els. 

[0007] It Is still another object of the present Invention 
15 to provide a digital watermark detecting method arKi 
system capable of detecting embedded data not only 
under the image condition t>ut also under the condition 
of conrpression streams. 

[0008] In order to achieve the above objects, the 
20 invention provkies the following four solution methods. 
[0009] According to a first aspect of the invention, a 
first data embedding and detecting approach is pro- 
vided in which data is embedded in a two-dimensional 
image as a position pattern of blocks whose pixel values 
25 are changed. Accordingly, a reliability same as that 
obtained through conventional techniques can be 
retained inespective of that the number of pixels whose 
values are changed is smaller. 
[001 0] According to a second aspect of the invention. 
30 a second data embedding and detecting approach is 
provided in which a sum (or average) of pixel values of 
partial images is changed to a specific value. Accord- 
ingly, it becomes possible to optimize the change 
amount of pixel values of partial images. 
35 [001 1 ] According to a third aspect of the invention, a 
data embedding system is provided which uses the first 
and second data embedding approaches. 
[001 2] According to a fourth aspect of the Invention, a 
data detecting system is provided which uses the first 
40 and second data detecting approaches. 

[0013] According to a fifth aspect of the invention, an 
approach is provided in which the first and second 
aspects are connbined. namely, an image is divided into 
blocks of k X 1 pixels and a sum or average of pixel val- 
45 ues of each block is changed to a value satisfying par- 
ticular conditions. 

[0014] According to a sixth aspect of the invention, an 
approach is provided in which the size of each block 
embedded with watermark infornriation based upon the 

50 fifth aspect is set to the size (e.g., 8x8 pixels) of a block 
used as the processing unit of a compression process 
such as JPEG and MPEG. Accordingly, embedded data 
under the image corKfition and under the condition of 
compression streams has one-to-one correspondence 

55 so that the embedded data can be detected both under 
the image condition and under the condition of com- 
pression streams. 

[001 5] Other objects, features and advantages of the 
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present invention will become apparent from reading 
the following description of the invention taken in con- 
junction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 5 
[0016] 

Fig. 1 is a diagram illustrating a method of embed- 
ding data in an image, according to an embodiment io 
of the invention. 

Fig, 2 is a flow chart illustrating a pixel value chang- 
ing approach according to an embodiment of the 
invention. 

Fig. 3 is a diagram showing a data embedding sys- is 
tern according to an emtx)diment of the invention. 
Fig. 4A is a diagram illustrating a method of detect- 
ing data from an image, according to an embodi- 
ment of the invention. 

Fig. 4B Is a diagram showing a data detecting sys- 20 
tem according to an embodiment of ihe invention. 
Figs. 5A to 5C are diagrams illustratirKi an example 
of watermark embedding and detecting realized by 
software. 

Fig. 6 is a flow chart illustrating an application of the 25 
invention to image data to be recorded in a record- 
ing medium, according to an embodiment of the 
invention. 

Fig. 7 is a diagram illustrating a method of embed- 
ding data in an image according to an embodiment 3o 
of the invention. 

Fig. 8 is a diagram showing a system of embedding 
data in an image according to an embodiment of 
the invention. 

Fig. 9 is a flow chart illustrating a method of embed- 3s 
ding data in an image according to an embodiment 
of the invention. 

Fig. 10 is a flow chart illustrating a method of 
detecting data from an image according to an 
embodiment of the invention. 40 
Fig. 11 is a diagram illustrating a method of embed- 
ding data in an innage according to an embodiment 
of the invention. 

Fig. 12 is a correspondence table illustrating a 
method of embedding data in an image according 45 
to an embodiment of the invention. 
Fig. 13 is a flow chart illustrating a method of 
embedding data in an image according to an 
embodiment of the invention. 

Fig. 14 is a flow chart illustrating a metiiod of so 
detecting data from an image according to an 
embodiment of the invention. 
Fig. 15 is a diagram illustrating a method of embed- 
ding data in an image according to an emtxxiiment 
of the invention. 55 
Fig. 16 is a diagram illustrating a method of emt>ed- 
ding data in an image according to an embodiment 
of the invention. 



Fig. 17 is a diagram illustrating a method of embed- 
ding data in an image according to an embodiment 
of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[001 7] Embodiments of the invention will be described 
with reference to the accompanying drawings. 
[0018] First, an embodiment according to the first 
aspect of the invention will be described with reference 
to Rg. 1 which is a schematic diagram illustrating an 
approach to embedding data in an image. In the first 
embodiment shown in Fig. 1 , each block 2 divided from 
an image 1 having m x n pixels represents a two-dimen- 
sional partial image of k x i pixels where m, n. k and I are 
positive integers. A block 3 with hatched lines has pixel 
values changed through a pixel value changing 
approach so that the block 3 has a specific value, the 
pixel value representing image information such as a 
luminance, a color difference, R, G and B color data. 
Information to be embedded is not represented by 
respective blocks, but it is represented by a block inter- 
val d. In this embodiment, the two-dimensional partial 
images whose pixel values are changed are disposed at 
the block interval d which corresponds to a data value x 
of a copyright notice for example, to thereby embed the 
data X in the image. In embedding watermark informa- 
tion, the data x is converted into the block interval d and 
the pixel values are changed based upon this block 
interval d. In detecting a watermark, a block pattern 
converted from tiie image is detected to read the btock 
interval and convert the block interval into ihe data. In 
this embodiment, although the block interval d corre- 
sponding to the data x is set constant, it may be 
changed. For exanple. tiiree different block intervals 
d1. d2 and d3 con^esponding to the data x may be cycli- 
cally used to irregularly dispose blocks whose pixel val- 
ues are changed. 

[0019] Next, a pixel value changing approach accord- 
ing to a second embodiment of the second aspect of the 
invention will be described. In embedding a watermark, 
each pixel value in a block of a two-dimensional partial 
image shown In Rg. 1 is changed so that the sum of 
pixel values of the block takes a specific value near the 
sum. For example, each pixel value in the partial image 
is changed so that the sum of luminance values of pixels 
takes a multiple of a certain value. 
[0020] This embodiment will be described with refer- 
ence to Fig. 2 which Is a flow chart illustrating the pixel 
value changing approach. Consider now that the size of 
the two-dimensional partial image is 8 x 8 pixels, and 
that each pixel value is changed so that the sum of pixel 
values of the partial image takes a multiple of "512", i.e.. 
so that the sum of pixel values is smaller than a particu- 
lar value (in this case "51 2"). It is assumed that pixels of 
each block are given pixel numbers from "1'to "64". 
[0021 ] Rrst at Step 201 . "1 " is set to a pixel number I. 
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At Step 202, each of the pixel values of the pixel number 
"r is incremented by "1". 

[0022] At Step 203 the sum of pixel values of the two- 
dimensional partial image (block) having 8x8 pixels is 
incremented or decremented by "1 " after the pixel value 
of the pixel number is changed. It is checked at Step 
204 whether the changed sum of the two-dimensional 
partial image is equal to the specific value of "512". If 
equal, this approach is terminated, whereas if not, the 
approach advances to Step 205 whereat it is checked 
whether the pixel number I is "64". i.e., whether all the 
pixels o1 the two-dimensional partial image have been 
changed. If changed, the approach is terminated, 
whereas if not. the pixel number I is inaemented by "1 " 
at Step 206 to change the pixel value of the next pixel. 
[0023] If this approach to simply changing each pixel 
value has a fear that a third party may steal the water- 
mark information, then a change anraunt in each pixel 
value representative of a luminance, a color difference, 
R, G. B or the like may be changed, as disclosed in the 
U.S. application being filed based on Japanese Patent 
Application No. 9-238031 filed on September 3. 1997 by 
the present assignee, et al. 

[0024] In detecting a watermark, the sum of pixel val- 
ues of each two-dimensional partial image (block) is cal- 
culated to check whether the sum is the specific value 
or a value near the specific value and to detect the btock 
whose pixel values were changed. In this case, a block 
is also detected, whose pixel values were not changed 
and its original sum was a value near the specific value. 
To deal with this issue, blocks can be detected at a 
higher precision if known pattern matching, majority 
decision, or the like is performed. Presumption of the 
specific value by a third party becomes difficult if a dif- 
ferent specific value is used for each two-dimensional 
partial image (block) depending upon the position of 
each partial image. 

[0025] Next, an embodiment according to the third 
aspect of the invention will be described with reference 
to Fig. 3 which is a schOTiatic diagram showing a data 
errtbedding system using the data embedding approach 
of the first and second emtxxliments. In the third 
embodiment shown in Rg. 3, data x to be embedded is 
converted into the block intaval d through the pixel 
value changing approach of the first embodiment, and 
blocks whose pixel values are to be changed are deter- 
mined. Next, the position information of the determined 
blocks is supplied to the image in which the data x is 
embedded, and the pixel values of each block is 
changed through the data errtoedding approach of the 
second embodiment. 

[0026] Next, a fourth embodiment according to the 
third aspect of the invention will be described with refer- 
ence to Fig. 4A which is a schematic diagram showing a 
data detecting system using the data detecting 
approach. In the fourth embodiment shown in Rg. 4A. 
blocks whose pixel values were changed are detected 
from two-dimensional partial images (t>locks) with the 



data X being embedded, by a changed t>lock detecting 
means which checks the specific value of each block 
from the sum of pixel values thereof. Next, the block 
interval between the blocks whose pixel values were 

5 changed is converted into the data x by a pattern detect- 
ing means, so that the data x can be reproduced from 
the watermark embedded image. 
[0027] Rg. 4B illustrates a modification of the fourth 
errtKxiiment shown in Fig. 4A. In Fig. 48, like elenrvents 

10 to those shown in Rg. 4A are represented by identical 
reference numerals. Reference numeral 23 represents 
a storage mear© for storing position information of 
blocks to be supplied to a pattern detecting means 21. 
In this fifth embodiment, after the position information 

75 detected with the changed trfock detecting means 20 is 
terrporarily stored in storage mans 23, a pattern is 
detected by the pattern detecting means 21 to repro- 
duce the data x. 

[0028] Figs. 5A to 5C illustrate an example of a 
20 method of embodying watermark embedding and 
detecting of this invention by using software running on 
a computer. 

[0029] Fig. 5A is a diagram illustrating a functbnal 
structure of the inside of a computer. In embedding a 

25 watermark, an image and embedding data are input 
from an input/output unit 501 and stored in a storage 
device 503. Next, an operation unit 502 executes a 
watermark embedding process, and a watermark 
embedded image is output from the input/output unit 

30 501. 

[0030] In detecting a watermark, a watermark embed- 
ded image is input from the input/output unit 501 and 
stored in the storage device 503. Next, the operation 
unit 502 executes a watermark detecting process, and 

35 embedded data is output from the input/output unit 50 1 . 
[0031] Fig. 58 is a diagram illustrating a functional 
structure of embedding a watermark. Reference numer- 
als 511. 512. and 513 represent processes to be exe- 
cuted by a CPU of the computer. Reference numerals 

40 514 to 516 represent data stored in the storage de/ice 
503 Of the computer. An input/output unit 51 1 stores 
image data 514 and embedding information (data x) 

515 in the storage device 503. In a watermark embed- 
ding process 513. the embedding information is con- 

45 verted into watermarking information which is 
embedded in image data 514. The watermark embed- 
ded image 516 is stored in the storage device. The 
watermark embedded image 516 stored in the storage 
device 503 is output from the input/output unit 501 . 

50 [0032] Fig. 5C is a diagram illustrating a functional 
structure of detecting a watermark. Reference numeral 
521 represents a process to be executed by CPU of the 
computer The input/output unit 51 1 stores a watermark 
embedded innage 516 in the storage device 503. In the 

55 watermark detecting process 521. watermarking infor- 
mation is derived from the watermark embedded image 

516 and converted into embedding information (data x) 
which is stored in the storage device 503. The embed- 
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ding information stored in the storage device 503 is out- 
put from the input/output unit 501. 
[0033] Fig. 6 is a flow chart illustrating an operation of 
storing an image embedded with data in a recording 
medium according to a fifth embodiment of the inven- 5 
tion. Reference numeral 32 represents a data embed- 
ding means of this invention, reference numeral 33 
represents an image compressing means, and refer- 
ence numeral 34 represents a formatting means spe- 
cific to a recording medium 35. Digital watermark data 
31 is embedded in a two<fimensional image 30 by the 
data embedding approach of this invention. The water- 
mark embedded two-dimensional image is then com- 
pressed by the image compressing means 33, 
formatted to have a format specific to the recording 
medium 35, and stored in the recording medium 35. It is 
therefore possible to form a recording medium such as 
an optical dsk which stores data such as a digital water- 
mark embedded two-dimensional image. 
[0034] Next, a sixth embodiment of the invention will 
be described. In this embodiment, watermark data can 
be detected both under the image condition and under 
the condition of conrpression streams. 
[0035] Fig. 7 is a diagram illustrating an example of a 
method of embedding data in an image, the method 
being suitable for an image compression process. In 
Fig. 7. reference numeral 171 represents a two-dimen- 
sional partial image (block) of 8 x 8 pixels. This size (8 x 
8 pixels] of the two-dimensional partial image 71 to be 
subjected to the pixel changing approach is an image 
processing unit of an image compression process such 
as JPEG and MPEG. Therefore, embedded information 
becomes hard to be lost during the image processing 
process. It is also known that sum of values of 8 x 8 pix- 
els is a DC component value of l-frame under the condi- 
tion of MPEG compression, i.e., MPEG streams. 
Therefore, the information embedded in such a manner 
that the sum of pixel values of each two-dimensional 
partial image takes the specific value, can be detected 
by judgirtg whether or not the DC component value of I- 
frame under the condition of MPEG streams takes the 
afcx>ve'described specific value and by deriving the 
interval of blocks satisfying the specific value. 
[0036] With this embodiment method, it is possible to 
derive the embedded information both under the image 
condition and under the condition of compression 
streams. If detection from only under the condition of 
compression streams is used, it is not necessary for a 
detector system to have a MPEG decoder so that the 
cost of the system can be bwered. 
[0037] Next, a seventh embodiment of the invention 
will be described. 

[0038] Fig. 8 is a schematic diagram illustrating the 
format of data embedded in an image. In Fig. 8. an 
image 81 of 720 x 480 pixels is divided into two-dimen- 
sional partial images (blocks) 82 each being constituted 
of 8 X 8 pixels. A macro block 83 is constituted of 64 
blocks. There are 84 macro blocks in the image. As 



shown, a y-th block in an x-th macro block is repre- 
sented by Bxy, where x is an integer from 1 to 84 and y 
is an integer from 1 to 64. Blocks in a block pattern 
whose pixel values are changed are disposed at a con- 
slant block interval d (in this example, d = 64). The 
embedding information is represented by a shift amount 
m (m = 0 to 63) of a block whose pixel values are 
changed. In this example, watermark information of 64 
types (6 bits) can be embedded, including block pat- 
terns of (811, 821..... 884 1). (812. 822..„, B84 2) 

(81 m-^1, 82 m+l 884 m+1)...., (81 64. 82 64..... 

884 64). 

[0039] In the example shown in Fig. 8, the block pat- 
tern (81 1 , 821 884 1) 84 is embedded. 

[0040} Fig. 9 is a flow chart illustrating the data 
embedding method. 

[0041} At Step 901 a bfock pattern shift amount m is 
calculated from 6-bit data x Step 902 and following 
Steps illustrate an operation of embedding watermark 
information in the block pattern (81 m+1, 82 m+1,.... 
884 m+l) shifted by m blocks from the block pattern 
(811, 821,..., 884 1). 

[0042] At Step 902 the number n of the macro block In 
which watermark information was embedded is set to 
"r. 

[0043] At Step 903 it is checked whether the water- 
mark information has been embedded in all the macro 
blocks (84 blocks). If embedded, the flow is terminated, 
whereas if not. the flow advances to Step 904. 
[0044] At Step 904 the (m+1)-th block in the n-th 
macro block is designated, and at Step 905 watermark 
information is embedded in the designated block by 
changing the pixel values thereof. 
[0045] At Step 906 the nunrt^er n of the macro block 
embedded with the watermark information is incre- 
mented by "1". 

[0046] Fig. 10 is a flow chart illustrating the data 
detecting approach. 

[0047] First, at Step 1002 the block pattern shift 
amount m is set to "0". 

[0048] At Step 1003 it is Checked whether detection 
number D tenrporarily stored in the system has been 
obtained for all the block patterns of 64 types. If 
obtained, the flow advances to Step 1012. whereas if 
not the flow advances to Step 1004. The detection 
nunrber D irxJicates the number of blocks satisfying a 
particular rule. For example, the detection number D is 
the nunr^er of blocks each having a sum of luminance 
values equal to a multiple of "512". 
[0049] At Step 1 004, the macro block number n is set 
to "1" and the detection number D is set to "0". 
[0050] At Step 1005 it is checked whether detection 
for all the macro blocks with the shift amount m has 
been completed. If completed, at Step 1010 a detection 
number Dm at the shift aniount m is stored as the detec- 
tion number D, and at Step 1011 the shift amount m is 
incremented by "1 " to continue the detecting process at 
the new shift amount. If not connpleted at Step 1005, the 
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flow advances to Step 1006 whereat the block Bn m+1 
in the n-th macro block at the shift amount m »s desig- 
nated. 

[0051 1 At Step 1 007 it is checked from the pixel values 
of the designated block whether the watermark informa- 
tion can be detected. If detected, at Step 1008 the 
detection number D is incremented by "1". and thereaf- 
ter at Step 1009 the macro block number n is incre- 
mented by "1" in order to designate the conresponding 
block in the next macro block. If not detected at Step 
1007. the flow advances directly to Step 1009 whereat 
only the macro block number n is incremented by "1". 
[0052] After the detection nurnbers Dm for all the shift 
amounts m are obtained, i.e.. after it is jiKJged at Step 
1003 as m = 63. at Step 1012 the detection number Dm 
larger than a threshold value is searched from the 
detection numbers Dm at respective shift nurrtoers m 
arxJ the shift amount m at the searched detection 
nurT±>er Dm is used as the shift amount m when the 
watemiark information was embedded. At Step 1013 
the shift amount m is converted into the data x to derive 
the watermark information. 

[0053] Next, an eighth embodiment of the invention 
will be described. 

[0054] Fig. 11 is a schematic diagram illustrating the 
format of data embedded in an image. Hatched blocks 
1 1 1 constitute a trfock pattern. 

[0055] A different point from the format shown in Fig. 
8 resides in that the block intervals of the block pattern 
whose pixel values are changed, are not constant but 
random. If the block interval is constant as shown in Fig. 
8, there is a fear that watermark information may be 
erroneously detected or easily removed illicitly, although 
depending on the type of an image. 
[0056] In accordance with a correspondence table 
between data x and a block pattern shown in Fig. 12, 
blocks in each block pattern are randomly allocated to 
each macro block, and data x of 6 bits can be embed- 
ded. The block pattern shown in Fig. 1 1 corresponds to 
the block pattern "1" shown in the table of Fig. 12. 
[0057] Fig. 13 is a flow chart illustrating the data 
errt^edding approach according to the eight emtxxJi- 
ment. 

[0058] At Step 1301 , data x is converted into a block 
pattern by referring to the correspondence table shown 
in Fig. 12. At Step 1302 watermark information is 
embedded randomly in a block Bn An (An is a random 
number series from "0" to "64") of the n-th macro block. 
Other Steps correspond to those described with Fig. 9. 
[0059] Fig. 14 is a flow chart illustrating the data 
detecting approach. 

[0060] At Step 1401 the block pattern number p 
shown in Fig. 12 is set to "1". 

[0061] At Step 1402 it is checked whether detection 
has been obtained for all the block patterns of 64 types. 
If obtained, the flow advances to Step 1405, whereas if 
not, the fbw advances to Step 1004 whereat the macro 
block number n and detection number D are initiaiized. 



[0062] If detection for all the 84 maao blocks in one 
block pattern has been completed at Step 1005, a 
detection number Dp at the block pattern p is stored at 
Step 1 404 as the detection number D, and at Step 1 405 
5 the block pattern p is incremented by "1". If not com- 
pleted at Step 1005, the flow advances to Step 1403 
whereat the An-th block Bn An in the n-th macro block is 
designated and watermark information is detected at 
Step 1007. 

10 [0063] If detection has been obtained for all the block 
patterns at the judgement Step 1402. then at Step 1402 
the block pattern p detection number Dp larger than a 
threshold value is searched from the detection numbers 
Dp and the block pattern p at the searched detection 
15 number Dp is used as the block pattern q when the 
watermark information was embedded. At Step 1407 
the block pattern p is converted into the data x by refer- 
ring to the correspondence table shown in Fig. 12 to 
derive the watermark information. 
20 [0064] Next, a ninth embodiment of the invention will 
be described. In the seventh and eighth embodiments, 
6-bit watermark information can be embedded because 
the block interval is set to "64" without permitting any 
duprication of blocks between block patterns. This ninth 
25 embodiment aims to allow watermark inforrration of 6 
bits or larger to be embedded, by permitting duplication 
of blocks between block patterns while the numl^er of 
blocks of each block pattern is maintained "84". 
[0065] Fig. 15 is a schematic diagram of an image 
30 ent)edded with a 7-bit watermark information by the 
embodiment data erTt>edding method. There are 128 
btock patterns in total. In Fig. 15, hatched blocks 
embedded with watermark information are shown dis- 
posed in respective macro blocks of each block pattern. 
35 The data embedding method same as the seventh 
embodiment is used for the block patterns 1 to 64. 
Namely, these block patterns 1 to 64 are represented by 

(B11. 821..... B84 1), (B12, B22 B84 2) (B1 64, 

B2 64 B84 64). The block patterns 65 to 128 are 

40 formed in accordance the foltowing rules, as illustrated 
in Fig. 15. 

[0066] The block pattern p is represented by (81 (p- 

1)mod64+1, B2 (p-2)mod64+2 Bn (p-1)rTOd64+n,..., 

884 (p-1)mod64+84). A mod B is a remainder of A 
45 divided by B, and the second suffix of B takes "1 " after 
"64". For exanple. B80 65 = B80 1 , B80 66 = B80 2. and 
soon. 

[0067] With this block pattern setting, the embedding 
position of a block in each nnacro block in one block pat- 
so tern becomes essentially coincident with the errtoed- 
ding position of a corresponding macro block in another 
block pattern. The number of coincident embedding 
positions between arbitrary two block patterns is "2". For 
example, in the block patterns shown in Fig. 15. the 
55 watermark embedding position of the macro block 2 of 
the block pattern 65 is B2 2 which Is the same as that of 
the macro block 2 of tiie btock pattern 2. In all the block 
patterns, the number of coincident watermark embed- 
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ding positions of the block patterns 65 and 2 is "2" and 
this is true for any of other combinations of two block 
patterns. In the above manner. sirKe blocks between 
block patterns are duplicated, information of larger bits 
can be embedded. In this embodiment data embedding 5 
method, blocks may be determined randomly by using 
the eighth embodiment described above. 
[0068] The data embedding method and detecting 
method of this embodiment are similar to those shown 
in Figs. 13 and 14 except that An is set so as to match 10 
the ninth embodiment. The description of the methods 
is therefore omitted. 

[0069] A tenth embodiment of the invention will be 

desaibed with reference to Figs. 16 and 17. 

[0070] This embodiment aims to embed watermark 15 

information of 8 bits or larger, expanding the ninth 

emlxxJiment. 

[0071 ] Figs. 1 6 and 1 7 are schematic diagrams of an 
image embedded with an 8-bit watermark information 
by the embodiment data embedding method. There are 20 
256 block patterns in total. The other layout of the blocks 
is the same as that shown in Fig. 15. 
[0072] Block patterns in Figs. 16 and 17 are repre- 
sented as in the following. 

[0073] Block patterns p 1 to 64 are represented in the 25 

manner same as the ninth embodiment. 

[0074] Block patterns p 65 to 128 are represented by 

(B1 {p-1)mod64+1. 82 (p-2)mod64+1+7..... Bn (p- 

1)nrKxJ64+1+7(n-1),..., B84 (p-1)mod64+1+7*83). 

[0075] Block patterns p 1 29 to 1 92 are represented by 30 

(Bl (p-1)nral64+1, B2 (p-2)nrKXl64+1+11 Bn (p- 

1)mod64+1+11(n-1),..., B84 (p-1)mod64+1+ 11*83). 
[0076] Block patterns p 1 93 to 256 are represented by 

(Bl (p-1)mod64+1. B2 (p-2)mod64+1+13 Bn (p- 

1)mod64+1+13(n-1 ),.... B84 (p-1)mod64+1 +13*83). 35 
[0077] Similar to the ninth embodiment, A mod B is a 
remainder of A divided by B, and the second suffix of B 
takes "1" after "64". For example, B80 65 = B80 1. B80 
66 = B80 2. and SO on. 

[0078] With this block pattern setting, waternnark infor- 40 
mation can be embedded while duplication of block pat- 
terns is minimized. Namely, by making uniform the 
number of arbitrary duplication block patterns, the 
number of duplications can be minimized. 
[0079] According to the invention, it is possible to 45 
embed data such as digital watermark information in a 
two-dimensional image and to detect the embedded 
data from a data embedded two-dimensional innage. 
while a change in the contents is minimized, the image 
quality is prevented from being degraded, and the data so 
detection reliability is improved. 

[0080] Furthermore, by designating the size of a two- 
dimensional partial image, not only embedded informa- 
tion becomes hard to be lost during an image compres- 
sion process, but also the embedded information can be ss 
derived and reproduced both under the image condition 
and under the condition of connpression streams. If 
detection only under the corxJition of compression 



streams is performed, it is not necessary for a detector 
system to install a MPEG decoder and the system cost 
can be lowered. 

Claims 

1. A data embedding method of embedding water- 
marking data X In a two-dimensional inriage (1) hav- 
ing rn horizontal pixels and n vertical pixels, 
conprising the steps of: 

selecting a two-dimensional partial image (2, 3) 
whose pixel values are to be changed In order 
to embed the watermarking data x, the two- 
dimensional partial image having k horizontal 
pixels (k X i s m , where k. i and m are positive 
integers) and I vertical pixels (I x j = n , where I, 
j arxj n are positive integers); arKi 
changing (11) a value of each pixel of the 
selected two-dimensional partial image such 
that a sum of pixel values of the selected two- 
dimensional partial image takes a specific 
value to thereby generate digital watermarks. 

2. A data embedding system for embedding water- 
marking data X in a two-dimensional image (1) hav- 
ing m horizontal pixels and n vertical pixels, 
comprising: 

selecting means for selecting a two-dimen- 
sional partial image (2, 3) whose pixel values 
are to be changed in order to embed the water- 
marking data X, the two-dimensional partial 
image having k horizontal pixels (k x i = m , k, i 
and m are positive integers) and 1 vertical pixels 
(I X j = n . I, j and n are positive integers); and 
pixel value changing means (11) coupled to 
said selecting means for changing a value of 
each pixel of the selected two-dimensional par- 
tial image such that a sum of pixel values of the 
selected two-dimensional partial image takes a 
specific value to thereby generate digital water- 
marks. 

3. A recording medium storing a moving image 
embedded with the watermarking data x by the data 
embedding method according to claim 1 and com- 
pressed. 

4. A data reproducing method comprising the steps 
of: 

detecting (20) the two-dimensional partial 
image whose pixel values were changed, the 
two-dimensional partial image corresponding 
to the watermarking data x embedded by the 
data embedding method accading to claim 1 ; 
storing (23) position information of the two- 
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dimensional partial image of the two-dimen- 
sional image detected by said detecting step in 
storage means; and 

detecting (21) a pattern of the position informa- 
tion of the two-dimensional partial image 
stored in the storage means. 

5. A data reproducing system comprising: 

two-dimensional partial image detecting 
means (20) for detecting the two-dimensional 
partial image whose pixel values were 
changed, the two-dimensional partial image 
corresponding to the watermarking data x 
embedded by the data embedding method 
according to daim 1 ; 

storing means (23) for storing position informa- 
tion of the two-dimensional partial image of the 
two-dimensional image detected by said 
detecting step; and 

pattern detecting means (21) for detecting a 
pattern of the position information of the two- 
dimensional partial image stored in the storage 
means. 

6. A method of embedding watermarking information 
in two<Jimer^ional image data, corrprising the 
steps of: 

dividing the two-dimensional image data into a 
plurality of blocks; 

selecting a partial set (83) of blocks corre- 
sponding to the watermarking infornnation from 
a plurality of divided blocks; and 
changing (84) values of image data in a block 
of the selected partial set of blocks so as to sat- 
isfy a particular condition to thereby generate 
digital watermarks. 

7. A method according to claim 6. wherein the block is 
a two-dimensional partial image constituting a com- 
pression processing unit. 

8. A method according to claim 6. wherein the block is 
a two-dimensional partial image, and the values of 
image data are a sum of luminances of pixels in 
each block. 

9. A method according to claim 6, wherein the partial 
set of blocks corresponcfing to the watermarking 
information is selected depending upon the water- 
marking information and random integers. 



sum of blocks, and M is the number of partial sets 
(macro blocks) of blocks and N and M are positive 
integers (Fig. 1). 

5 11 . A method according to claim 6, wherein the partial 
set of blocks is selected so as to duplicate trfocks 
between types of the watermarking Infornnation, a 
difference of duplk;ated block numbers between 
arbitrary two partial sets of blocks being set to 0 or 

10 1, if A larger than N/M where A is the number of 
types of the watermarking information. N is a total 
sum of blocks, and M is the numt>er of partial sets 
(macro blocks) of bocks and N, are positive inte- 
gers (Figs. 15-17). 

15 

12. A method of reading watermarking information 
emt>edded in two<iimensional image data, com- 
prising the steps of: 

20 dividing (1401) the two-dimensional image 

data into a plurality of blocks; 
storing (1404) partial sets of blocks in cone- 
spondence with each type of the watermark 
information; 

25 judging whether a value of image data of each 

block satisfies a specif k; condition; 
comparing (1406) sets of blocks satisfying the 
specific condition with the partial sets of blocks 
and selecting a partial set of fc>locks having the 

30 number of blocks common in both the set of 

blocks and the partial set of blocks larger than 
a predetermined value; and 
judging (1407) information corresponding to 
the selected partial set of blocks as as the 

35 watermarking information. 

13. A method according to daim 12, wherein the two- 
dimensional image data Is compressed image data, 
and whether the value of image data of each block 

40 satisfies the specific condition is judged from a cor- 
respondence between a value of compressed data 
and a value of image data. 

14. A system for embedding watermarking Information 
45 in two-dimensional image data, comprising: 

means for dividing the two-dimensional image 
data Into a plurality of blocks; 
means for selecting a partial set (83) of blocks 
50 corresponding to the watermarking Information 

from a plurality of divided blocks and changing 
(84) values of Image data In a block of the 
selected partial set of blocks so as to satisfy a 
particular condition to thereby generate digital 
watermarks. 



10. A method according to claim 6, wherein the partial 
set of blocks is selected so as not to duplicate ss 
blocks between types of the watermarking informa- 
tion, if A is N/K/l or smaller where A is the nun±>er of 
types of the watermarking information, N is a total 
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compression processing unit. 

16. A system according to claim 14, wherein the block 
is a two-dimensional partial image, and the values 

of image data are a sum of luminances of pixels in s 
each block. 

1 7. A method according to claim 1 4, wherein the partial 
set of blocks corresponding to the watermarking 
information is selected depending upon the water- io 
marking information and random integers. 

18. A system according to claim 14, wherein the partial 
set of blocks is selected so as not to duplicate 
blocks between types of the watermarking informa- is 
tion, if A is N/M or smaller where A is the number of 
types of the watermarking information, N is a total 
sum of blocks, and M is the number of partial sets 
(macro blocks) of blocks and N and M are positive 
integers (Fig. 1). 20 

1 9. A system according to claim 14, wherein the partial 
set of blocks is selected so as to duplicate blocks 
between types of the watermarking information, a 
difference of duplicated block numbers between 2S 
arbitrary two partial sets of blocks being set to 0 or 

1. If A larger than N/M where A is the number of 
types of the watermarking information. N is a total 
sum of blocks, and M is the number of partial sets 
(macro blocks) of blocks and N and M are positive 30 
integers (Figs. 15-17). 

20. A system for reading watermarking information 
embedded in two-dimensional image data, com- 
prising: 35 

— means for dividing (1401) the two-dimensional 
image data into a plurality of blocks; 
means for storing (1404) partial sets of blocks 
in correspondence with each type of the water- 40 
mark information; 

means for judging whether a value of image 
data of each block satisfies a specific condition; 
means for comparing (1 406) sets of blocks sat- 
isfying the specific condition with the partial 45 
sets of blocks and selecting a partial set of 
blocks having the number of blocks common in 
both the set of blocks and the partial set of 
blocks larger than a predetermined value; and 
means for judging (1407) irrformation corre- so 
sponding to the selected partial set of blocks as 
as the watermarking information. 

21. A system according to claim 20, wherein the two- 
dimensional image data is compressed image data, ss 
and whether the value of image data of each block 
satisfies the specific condition is judged from a cor- 
respondence between a value of compressed data 



and a value of image data. 

22. A computer-readable storage medium storing a 
program which implements by the corrputer a data 
embedding operation of embedding waternriarking 
data X in a two-dimensional image ( 1 ) having m hor- 
izontal pixels and n vertical pixels, said program 
comprising the steps of: 

selecting a two-dimensional partial image (2, 3) 
whose pixel values are to be changed in order 
to embed the watermarking data x, the two- 
dimensional partial image having k horizontal 
pixels (k X i = m . i is a positive integer) and I 
vertical pixels (I x j = n , j is a positive integer); 
and 

changing (11) a value of each pixel of the 
selected two-dimensional partial image so that 
a sum of pixel values of the selected two- 
dimensional partial image takes a specific 
value to thereby generate digital watermarks. 

23. A computer-readable storage medium storing a 
program which implements by the computer a data 
reproducing operation, said program connprising 
the steps of: 

detecting (20) the two-dimensional partial 
image whose pixel values were changed, the 
two-dimensional partial image corresponding 
to the watermarking data x errtoedded by the 
data embedding method according to claim 22; 
storing (23) position information of the two- 
dimensional partial image of tiie two-dimen- 
sional image detected by said detecting step in 
storage means; and 

detecting (21) a pattern of the position informa- 
tion of tiie two-dimensional partial image 
stored in the storage means. 

24. A computer-readable storage medium storing a 
program which implements by the computer an 
operation of embedding watermarking information 
in two-dimensional image data, said program com- 
prising the steps of: 

dividing the two-dimensional image data into a 
plurality of blocks; 

selecting a partial set (83) of blocks corre- 
sponding to the watermarking information from 
a plurality of divided Nocks; and 
changing (84) values of image data in a block 
of the selected partial set of blocks so as to sat- 
isfy a particular condition to thereby generate 
digital watermarks. 

25. A computer-readable storage medium storing a 
program which implements by the computer an 
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operation of reading watermarking information 
embedded in two-dimensional image data, said 
program corrprising the steps of : 

dividing (1401) the two-dimensional image s 
data into a plurality of blocks; 
storing (1404) partial sets of blocks in corre- 
spondence with each type of the watermark 
information; 

judging whether a value of image data of each io 
block satisfies a specific condition; 
comparing (1406) sets of blocks satisfying the 
specific condition with the partial sets of blocks 
and selecting a partial set of blocks having the 
number of blocks common in both the set of is 
blocks and the partial s^ of blocks larger than 
a predetermined value; and 
judging (1407) information corresponding to 
the selected partial set of blocks as as the 
watermarking information. 20 
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